Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Improve test flakiness #27556

Closed
wants to merge 4 commits into from
Closed

Conversation

pnarayanaswamy
Copy link
Contributor

@pnarayanaswamy pnarayanaswamy commented Oct 2, 2024

Description

Improves the flakiness tests:

  • "Simple Send Security Alert - Blockaid @no-mmi should not show security alerts for benign requests"

Removes deprecated switchToNotification window: "Transfer custom tokens @no-mmi transfer custom tokens from dapp customizing gas values"

Open in GitHub Codespaces

Related issues

Fixes: #22563 #24633

Manual testing steps

  1. Go to this page...

Screenshots/Recordings

Before

After

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@pnarayanaswamy pnarayanaswamy requested a review from a team as a code owner October 2, 2024 09:38
Copy link
Contributor

github-actions bot commented Oct 2, 2024

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@github-actions github-actions bot added the team-confirmations Push issues to confirmations team label Oct 2, 2024
@metamaskbot
Copy link
Collaborator

Builds ready [75ab876]
Page Load Metrics (1863 ± 58 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint40121431787341164
domContentLoaded16072058182211254
load16442159186312158
domInteractive28246614722
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@@ -118,7 +117,7 @@ describe('Transfer custom tokens @no-mmi', function () {
// transfer token from dapp
await openDapp(driver, contractAddress);
await driver.clickElement({ text: 'Transfer Tokens', tag: 'button' });
await switchToNotificationWindow(driver);
await driver.switchToWindowWithTitle(WINDOW_TITLES.Dialog);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why does this improve flakiness? What is the cause of the issue being solved?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was just refactoring the deprecated method, mainly there is no real flakiness on this test. Multiple re runs of it don't show any.

@metamaskbot
Copy link
Collaborator

Builds ready [db58611]
Page Load Metrics (2025 ± 101 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint44224011916385185
domContentLoaded161324561987214103
load162124902025211101
domInteractive18110512512
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

Copy link

sonarcloud bot commented Oct 3, 2024

@metamaskbot
Copy link
Collaborator

Builds ready [f5117a5]
Page Load Metrics (1737 ± 61 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint32119981668334160
domContentLoaded14701981171812761
load14781992173712861
domInteractive167140178
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@github-actions github-actions bot locked and limited conversation to collaborators Nov 4, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
team-confirmations Push issues to confirmations team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix flaky test: "Transfer custom tokens @no-mmi transfer custom tokens from dapp customizing gas values"
3 participants